Influenza vaccine effectiveness against hospitalized SARS-CoV-2 infection (preprint)

AO_SCPLOWBSTRACTC_SCPLOWO_ST_ABSBackgroundC_ST_ABSSome studies conducted before the Delta and Omicron variant-dominant periods have indicated that influenza vaccination provided protection against COVID-19 infection or hospitalization, but these results were limited by small study cohorts and a lack of comprehensive data on patient characteristics. No studies have examined this question during the Delta and Omicron periods (08/01/2021 to 2/22/2022). MethodsWe conducted a retrospective cohort study of influenza-vaccinated and unvaccinated patients in the Corewell Health East(CHE, formerly known as Beaumont Health), Corewell Health West(CHW, formerly known as Spectrum Health) and Michigan Medicine (MM) healthcare system during the Delta-dominant and Omicron-dominant periods. We used a test-negative, case-control analysis to assess the effectiveness of the influenza vaccine against hospitalized SARS-CoV-2 outcome in adults, while controlling for individual characteristics as well as pandameic severity and waning immunity of COVID-19 vaccine. ResultsThe influenza vaccination has shown to provided some protection against SARS-CoV-2 hospitalized outcome across three main healthcare systems. CHE site (odds ratio [OR]=0.73, vaccine effectiveness [VE]=27%, 95% confidence interval [CI]: [18-35], p<0.001), CHW site (OR=0.85, VE=15%, 95% CI: [6-24], p<0.001), MM (OR=0.50, VE=50%, 95% CI: [40-58], p <0.001) and overall (OR=0.75, VE=25%, 95% CI: [20-30], p <0.001). ConclusionThe influenza vaccine provides a small degree of protection against SARS-CoV-2 infection across our study sites.

A spatial and contextual exposome-wide association study and polyexposomic score of COVID-19 hospitalization.

Environmental exposures have been linked to COVID-19 severity. Previous studies examined very few environmental factors, and often only separately without considering the totality of the environment, or the exposome. In addition, existing risk prediction models of severe COVID-19 predominantly rely on demographic and clinical factors. To address these gaps, we conducted a spatial and contextual exposome-wide association study (ExWAS) and developed polyexposomic scores (PES) of COVID-19 hospitalization leveraging rich information from individuals' spatial and contextual exposome. Individual-level electronic health records of 50 368 patients aged 18 years and older with a positive SARS-CoV-2 PCR/Antigen lab test or a COVID-19 diagnosis between March 2020 and October 2021 were obtained from the OneFlorida+ Clinical Research Network. A total of 194 spatial and contextual exposome factors from 10 data sources were spatiotemporally linked to each patient based on geocoded residential histories. We used a standard two-phase procedure in the ExWAS and developed and validated PES using gradient boosting decision trees models. Four exposome measures significantly associated with COVID-19 hospitalization were identified, including 2-chloroacetophenone, low food access, neighborhood deprivation, and reduced access to fitness centers. The initial prediction model in all patients without considering exposome factors had a testing-area under the curve (AUC) of 0.778. Incorporation of exposome data increased the testing-AUC to 0.787. Similar findings were observed in subgroup analyses focusing on populations without comorbidities and aged 18-24 years old. This spatial and contextual exposome study of COVID-19 hospitalization confirmed previously reported risk factor but also generated novel predictors that warrant more focused evaluation.

Data-driven analysis to understand long COVID using electronic health records from the RECOVER initiative.

Recent studies have investigated post-acute sequelae of SARS-CoV-2 infection (PASC, or long COVID) using real-world patient data such as electronic health records (EHR). Prior studies have typically been conducted on patient cohorts with specific patient populations which makes their generalizability unclear. This study aims to characterize PASC using the EHR data warehouses from two large Patient-Centered Clinical Research Networks (PCORnet), INSIGHT and OneFlorida+, which include 11 million patients in New York City (NYC) area and 16.8 million patients in Florida respectively. With a high-throughput screening pipeline based on propensity score and inverse probability of treatment weighting, we identified a broad list of diagnoses and medications which exhibited significantly higher incidence risk for patients 30-180 days after the laboratory-confirmed SARS-CoV-2 infection compared to non-infected patients. We identified more PASC diagnoses in NYC than in Florida regarding our screening criteria, and conditions including dementia, hair loss, pressure ulcers, pulmonary fibrosis, dyspnea, pulmonary embolism, chest pain, abnormal heartbeat, malaise, and fatigue, were replicated across both cohorts. Our analyses highlight potentially heterogeneous risks of PASC in different populations.

Identifying environmental risk factors for post-acute sequelae of SARS-CoV-2 infection: An EHR-based cohort study from the recover program.

Post-acute sequelae of SARS-CoV-2 infection (PASC) affects a wide range of organ systems among a large proportion of patients with SARS-CoV-2 infection. Although studies have identified a broad set of patient-level risk factors for PASC, little is known about the association between "exposome"-the totality of environmental exposures and the risk of PASC. Using electronic health data of patients with COVID-19 from two large clinical research networks in New York City and Florida, we identified environmental risk factors for 23 PASC symptoms and conditions from nearly 200 exposome factors. The three domains of exposome include natural environment, built environment, and social environment. We conducted a two-phase environment-wide association study. In Phase 1, we ran a mixed effects logistic regression with 5-digit ZIP Code tabulation area (ZCTA5) random intercepts for each PASC outcome and each exposome factor, adjusting for a comprehensive set of patient-level confounders. In Phase 2, we ran a mixed effects logistic regression for each PASC outcome including all significant (false positive discovery adjusted p-value < 0.05) exposome characteristics identified from Phase I and adjusting for confounders. We identified air toxicants (e.g., methyl methacrylate), particulate matter (PM2.5) compositions (e.g., ammonium), neighborhood deprivation, and built environment (e.g., food access) that were associated with increased risk of PASC conditions related to nervous, blood, circulatory, endocrine, and other organ systems. Specific environmental risk factors for each PASC condition and symptom were different across the New York City area and Florida. Future research is warranted to extend the analyses to other regions and examine more granular exposome characteristics to inform public health efforts to help patients recover from SARS-CoV-2 infection.

Data-driven identification of post-acute SARS-CoV-2 infection subphenotypes.

The post-acute sequelae of SARS-CoV-2 infection (PASC) refers to a broad spectrum of symptoms and signs that are persistent, exacerbated or newly incident in the period after acute SARS-CoV-2 infection. Most studies have examined these conditions individually without providing evidence on co-occurring conditions. In this study, we leveraged the electronic health record data of two large cohorts, INSIGHT and OneFlorida+, from the national Patient-Centered Clinical Research Network. We created a development cohort from INSIGHT and a validation cohort from OneFlorida+ including 20,881 and 13,724 patients, respectively, who were SARS-CoV-2 infected, and we investigated their newly incident diagnoses 30-180 days after a documented SARS-CoV-2 infection. Through machine learning analysis of over 137 symptoms and conditions, we identified four reproducible PASC subphenotypes, dominated by cardiac and renal (including 33.75% and 25.43% of the patients in the development and validation cohorts); respiratory, sleep and anxiety (32.75% and 38.48%); musculoskeletal and nervous system (23.37% and 23.35%); and digestive and respiratory system (10.14% and 12.74%) sequelae. These subphenotypes were associated with distinct patient demographics, underlying conditions before SARS-CoV-2 infection and acute infection phase severity. Our study provides insights into the heterogeneity of PASC and may inform stratified decision-making in the management of PASC conditions.

Incidence Trends of New-Onset Diabetes in Children and Adolescents Before and During the COVID-19 Pandemic: Findings From Florida.

This study examined the incidence trends of new-onset type 1 and type 2 diabetes in children and adolescents in Florida before and during the coronavirus disease 2019 (COVID-19) pandemic. In this observational descriptive cohort study, we used a validated computable phenotype to identify incident diabetes cases among individuals <18 years of age in the OneFlorida+ network of the national Patient-Centered Clinical Research Network between January 2017 and June 2021. We conducted an interrupted time series analysis based on the autoregressive integrated moving average model to compare changes in age-adjusted incidence rates of type 1 and type 2 diabetes before and after March 2020, when COVID-19 was declared a national health emergency in the U.S. The age-adjusted incidence rates of both type 1 and type 2 diabetes increased post-COVID-19 for children and adolescents. These results highlight the need for longitudinal cohort studies to examine how the pandemic might influence subsequent diabetes onset in young individuals.

A scoping review of semantic integration of health data and information.

OBJECTIVE: We summarized a decade of new research focusing on semantic data integration (SDI) since 2009, and we aim to: (1) summarize the state-of-art approaches on integrating health data and information; and (2) identify the main gaps and challenges of integrating health data and information from multiple levels and domains. MATERIALS AND METHODS: We used PubMed as our focus is applications of SDI in biomedical domains and followed the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) to search and report for relevant studies published between January 1, 2009 and December 31, 2021. We used Covidence-a systematic review management system-to carry out this scoping review. RESULTS: The initial search from PubMed resulted in 5,326 articles using the two sets of keywords. We then removed 44 duplicates and 5,282 articles were retained for abstract screening. After abstract screening, we included 246 articles for full-text screening, among which 87 articles were deemed eligible for full-text extraction. We summarized the 87 articles from four aspects: (1) methods for the global schema; (2) data integration strategies (i.e., federated system vs. data warehousing); (3) the sources of the data; and (4) downstream applications. CONCLUSION: SDI approach can effectively resolve the semantic heterogeneities across different data sources. We identified two key gaps and challenges in existing SDI studies that (1) many of the existing SDI studies used data from only single-level data sources (e.g., integrating individual-level patient records from different hospital systems), and (2) documentation of the data integration processes is sparse, threatening the reproducibility of SDI studies.

Multisite learning of high-dimensional heterogeneous data with applications to opioid use disorder study of 15,000 patients across 5 clinical sites.

Integrating data across institutions can improve learning efficiency. To integrate data efficiently while protecting privacy, we propose A one-shot, summary-statistics-based, Distributed Algorithm for fitting Penalized (ADAP) regression models across multiple datasets. ADAP utilizes patient-level data from a lead site and incorporates the first-order (ADAP1) and second-order gradients (ADAP2) of the objective function from collaborating sites to construct a surrogate objective function at the lead site, where model fitting is then completed with proper regularizations applied. We evaluate the performance of the proposed method using both simulation and a real-world application to study risk factors for opioid use disorder (OUD) using 15,000 patient data from the OneFlorida Clinical Research Consortium. Our results show that ADAP performs nearly the same as the pooled estimator but achieves higher estimation accuracy and better variable selection than the local and average estimators. Moreover, ADAP2 successfully handles heterogeneity in covariate distributions.

Distributed Quasi-Poisson regression algorithm for modeling multi-site count outcomes in distributed data networks.

BACKGROUND: Observational studies incorporating real-world data from multiple institutions facilitate study of rare outcomes or exposures and improve generalizability of results. Due to privacy concerns surrounding patient-level data sharing across institutions, methods for performing regression analyses distributively are desirable. Meta-analysis of institution-specific estimates is commonly used, but has been shown to produce biased estimates in certain settings. While distributed regression methods are increasingly available, methods for analyzing count outcomes are currently limited. Count data in practice are commonly subject to overdispersion, exhibiting greater variability than expected under a given statistical model. OBJECTIVE: We propose a novel computational method, a one-shot distributed algorithm for quasi-Poisson regression (ODAP), to distributively model count outcomes while accounting for overdispersion. METHODS: ODAP incorporates a surrogate likelihood approach to perform distributed quasi-Poisson regression without requiring patient-level data sharing, only requiring sharing of aggregate data from each participating institution. ODAP requires at most three rounds of non-iterative communication among institutions to generate coefficient estimates and corresponding standard errors. In simulations, we evaluate ODAP under several data scenarios possible in multi-site analyses, comparing ODAP and meta-analysis estimates in terms of error relative to pooled regression estimates, considered the gold standard. In a proof-of-concept real-world data analysis, we similarly compare ODAP and meta-analysis in terms of relative error to pooled estimatation using data from the OneFlorida Clinical Research Consortium, modeling length of stay in COVID-19 patients as a function of various patient characteristics. In a second proof-of-concept analysis, using the same outcome and covariates, we incorporate data from the UnitedHealth Group Clinical Discovery Database together with the OneFlorida data in a distributed analysis to compare estimates produced by ODAP and meta-analysis. RESULTS: In simulations, ODAP exhibited negligible error relative to pooled regression estimates across all settings explored. Meta-analysis estimates, while largely unbiased, were increasingly variable as heterogeneity in the outcome increased across institutions. When baseline expected count was 0.2, relative error for meta-analysis was above 5% in 25% of iterations (250/1000), while the largest relative error for ODAP in any iteration was 3.59%. In our proof-of-concept analysis using only OneFlorida data, ODAP estimates were closer to pooled regression estimates than those produced by meta-analysis for all 15 covariates. In our distributed analysis incorporating data from both OneFlorida and the UnitedHealth Group Clinical Discovery Database, ODAP and meta-analysis estimates were largely similar, while some differences in estimates (as large as 13.8%) could be indicative of bias in meta-analytic estimates. CONCLUSIONS: ODAP performs privacy-preserving, communication-efficient distributed quasi-Poisson regression to analyze count outcomes using data stored within multiple institutions. Our method produces estimates nearly matching pooled regression estimates and sometimes more accurate than meta-analysis estimates, most notably in settings with relatively low counts and high outcome heterogeneity across institutions.

Syndromic Surveillance Systems for Mass Gatherings: A Scoping Review.

Syndromic surveillance involves the near-real-time collection of data from a potential multitude of sources to detect outbreaks of disease or adverse health events earlier than traditional forms of public health surveillance. The purpose of the present study is to elucidate the role of syndromic surveillance during mass gathering scenarios. In the present review, the use of syndromic surveillance for mass gathering scenarios is described, including characteristics such as methodologies of data collection and analysis, degree of preparation and collaboration, and the degree to which prior surveillance infrastructure is utilized. Nineteen publications were included for data extraction. The most common data source for the included syndromic surveillance systems was emergency departments, with first aid stations and event-based clinics also present. Data were often collected using custom reporting forms. While syndromic surveillance can potentially serve as a method of informing public health policy regarding specific mass gatherings based on the profile of syndromes ascertained, the present review does not indicate that this form of surveillance is a reliable method of detecting potentially critical public health events during mass gathering scenarios.

DLMM as a lossless one-shot algorithm for collaborative multi-site distributed linear mixed models.

Linear mixed models are commonly used in healthcare-based association analyses for analyzing multi-site data with heterogeneous site-specific random effects. Due to regulations for protecting patients' privacy, sensitive individual patient data (IPD) typically cannot be shared across sites. We propose an algorithm for fitting distributed linear mixed models (DLMMs) without sharing IPD across sites. This algorithm achieves results identical to those achieved using pooled IPD from multiple sites (i.e., the same effect size and standard error estimates), hence demonstrating the lossless property. The algorithm requires each site to contribute minimal aggregated data in only one round of communication. We demonstrate the lossless property of the proposed DLMM algorithm by investigating the associations between demographic and clinical characteristics and length of hospital stay in COVID-19 patients using administrative claims from the UnitedHealth Group Clinical Discovery Database. We extend this association study by incorporating 120,609 COVID-19 patients from 11 collaborative data sources worldwide.

Unraveling COVID-19: A Large-Scale Characterization of 4.5 Million COVID-19 Cases Using CHARYBDIS.

Purpose: Routinely collected real world data (RWD) have great utility in aiding the novel coronavirus disease (COVID-19) pandemic response. Here we present the international Observational Health Data Sciences and Informatics (OHDSI) Characterizing Health Associated Risks and Your Baseline Disease In SARS-COV-2 (CHARYBDIS) framework for standardisation and analysis of COVID-19 RWD. Patients and Methods: We conducted a descriptive retrospective database study using a federated network of data partners in the United States, Europe (the Netherlands, Spain, the UK, Germany, France and Italy) and Asia (South Korea and China). The study protocol and analytical package were released on 11th June 2020 and are iteratively updated via GitHub. We identified three non-mutually exclusive cohorts of 4,537,153 individuals with a clinical COVID-19 diagnosis or positive test, 886,193 hospitalized with COVID-19, and 113,627 hospitalized with COVID-19 requiring intensive services. Results: We aggregated over 22,000 unique characteristics describing patients with COVID-19. All comorbidities, symptoms, medications, and outcomes are described by cohort in aggregate counts and are readily available online. Globally, we observed similarities in the USA and Europe: more women diagnosed than men but more men hospitalized than women, most diagnosed cases between 25 and 60 years of age versus most hospitalized cases between 60 and 80 years of age. South Korea differed with more women than men hospitalized. Common comorbidities included type 2 diabetes, hypertension, chronic kidney disease and heart disease. Common presenting symptoms were dyspnea, cough and fever. Symptom data availability was more common in hospitalized cohorts than diagnosed. Conclusion: We constructed a global, multi-centre view to describe trends in COVID-19 progression, management and evolution over time. By characterising baseline variability in patients and geography, our work provides critical context that may otherwise be misconstrued as data quality issues. This is important as we perform studies on adverse events of special interest in COVID-19 vaccine surveillance.

The application of artificial intelligence and data integration in COVID-19 studies: a scoping review.

OBJECTIVE: To summarize how artificial intelligence (AI) is being applied in COVID-19 research and determine whether these AI applications integrated heterogenous data from different sources for modeling. MATERIALS AND METHODS: We searched 2 major COVID-19 literature databases, the National Institutes of Health's LitCovid and the World Health Organization's COVID-19 database on March 9, 2021. Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline, 2 reviewers independently reviewed all the articles in 2 rounds of screening. RESULTS: In the 794 studies included in the final qualitative analysis, we identified 7 key COVID-19 research areas in which AI was applied, including disease forecasting, medical imaging-based diagnosis and prognosis, early detection and prognosis (non-imaging), drug repurposing and early drug discovery, social media data analysis, genomic, transcriptomic, and proteomic data analysis, and other COVID-19 research topics. We also found that there was a lack of heterogenous data integration in these AI applications. DISCUSSION: Risk factors relevant to COVID-19 outcomes exist in heterogeneous data sources, including electronic health records, surveillance systems, sociodemographic datasets, and many more. However, most AI applications in COVID-19 research adopted a single-sourced approach that could omit important risk factors and thus lead to biased algorithms. Integrating heterogeneous data for modeling will help realize the full potential of AI algorithms, improve precision, and reduce bias. CONCLUSION: There is a lack of data integration in the AI applications in COVID-19 research and a need for a multilevel AI framework that supports the analysis of heterogeneous data from different sources.

Examination of Early CNS Symptoms and Severe Coronavirus Disease 2019: A Multicenter Observational Case Series.

To determine if early CNS symptoms are associated with severe coronavirus disease 2019. DESIGN: A retrospective, observational case series study design. SETTING: Electronic health records were reviewed for patients from five healthcare systems across the state of Florida, United States. PATIENTS: A clinical sample (n = 36,615) of patients with confirmed diagnosis of coronavirus disease 2019 were included. Twelve percent (n = 4,417) of the sample developed severe coronavirus disease 2019, defined as requiring critical care, mechanical ventilation, or diagnosis of acute respiratory distress syndrome, sepsis, or severe inflammatory response syndrome. INTERVENTIONS: None. MEASUREMENT AND MAIN RESULTS: We reviewed the electronic health record for diagnosis of early CNS symptoms (encephalopathy, headache, ageusia, anosmia, dizziness, acute cerebrovascular disease) between 14 days before the diagnosis of coronavirus disease 2019 and 8 days after the diagnosis of coronavirus disease 2019, or before the date of severe coronavirus disease 2019 diagnosis, whichever came first. Hierarchal logistic regression models were used to examine the odds of developing severe coronavirus disease 2019 based on diagnosis of early CNS symptoms. Severe coronavirus disease 2019 patients were significantly more likely to have early CNS symptoms (32.8%) compared with nonsevere patients (6.11%; χ2[1] = 3,266.08, p < 0.0001, φ = 0.29). After adjusting for demographic variables and pertinent comorbidities, early CNS symptoms were significantly associated with severe coronavirus disease 2019 (odds ratio = 3.21). Diagnosis of encephalopathy (odds ratio = 14.38) was associated with greater odds of severe coronavirus disease 2019; whereas diagnosis of anosmia (odds ratio = 0.45), ageusia (odds ratio = 0.46), and headache (odds ratio = 0.63) were associated with reduced odds of severe coronavirus disease 2019. CONCLUSIONS: Early CNS symptoms, and specifically encephalopathy, are differentially associated with risk of severe coronavirus disease 2019 and may serve as an early marker for differences in clinical disease course. Therapies for early coronavirus disease 2019 are scarce, and further identification of subgroups at risk may help to advance understanding of the severity trajectories and enable focused treatment.

How the clinical research community responded to the COVID-19 pandemic: an analysis of the COVID-19 clinical studies in ClinicalTrials.gov.

OBJECTIVE: In the past few months, a large number of clinical studies on the novel coronavirus disease (COVID-19) have been initiated worldwide to find effective therapeutics, vaccines, and preventive strategies for COVID-19. In this study, we aim to understand the landscape of COVID-19 clinical research and identify the issues that may cause recruitment difficulty or reduce study generalizability. METHODS: We analyzed 3765 COVID-19 studies registered in the largest public registry-ClinicalTrials.gov, leveraging natural language processing (NLP) and using descriptive, association, and clustering analyses. We first characterized COVID-19 studies by study features such as phase and tested intervention. We then took a deep dive and analyzed their eligibility criteria to understand whether these studies: (1) considered the reported underlying health conditions that may lead to severe illnesses, and (2) excluded older adults, either explicitly or implicitly, which may reduce the generalizability of these studies to the older adults population. RESULTS: Our analysis included 2295 interventional studies and 1470 observational studies. Most trials did not explicitly exclude older adults with common chronic conditions. However, known risk factors such as diabetes and hypertension were considered by less than 5% of trials based on their trial description. Pregnant women were excluded by 34.9% of the studies. CONCLUSIONS: Most COVID-19 clinical studies included both genders and older adults. However, risk factors such as diabetes, hypertension, and pregnancy were under-represented, likely skewing the population that was sampled. A careful examination of existing COVID-19 studies can inform future COVID-19 trial design towards balanced internal validity and generalizability.

An external exposome-wide association study of COVID-19 mortality in the United States.

The risk factors for severe COVID-19 beyond older age and certain underlying health conditions are largely unknown. Recent studies suggested that long-term environmental exposures may be important determinants of severe COVID-19. However, very few environmental factors have been studied, often separately, without considering the totality of the external environment (i.e., the external exposome). We conducted an external exposome-wide association study (ExWAS) using the nationwide county-level COVID-19 mortality data in the contiguous US. A total of 337 variables characterizing the external exposome from 8 data sources were integrated, harmonized, and spatiotemporally linked to each county. A two-phase procedure was used: (1) in Phase 1, a random 50:50 split divided the data into a discovery set and a replication set, and associations between COVID-19 mortality and individual factors were examined using mixed-effect negative binomial regression models, with multiple comparisons addressed, and (2) in Phase 2, a multivariable regression model including all variables that are significant from both the discovery and replication sets in Phase 1 was fitted. A total of 13 and 22 variables were significant in the discovery and replication sets in Phase 1, respectively. All the 4 variables that were significant in both sets in Phase 1 remained statistically significant in Phase 2, including two air toxicants (i.e., nitrogen dioxide or NO2, and benzidine), one vacant land measure, and one food environment measure. This is the first external exposome study of COVID-19 mortality. It confirmed some of the previously reported environmental factors associated with COVID-19 mortality, but also generated unexpected predictors that may warrant more focused evaluation.

How the clinical research community responded to the COVID-19 pandemic: An analysis of the COVID-19 clinical studies in ClinicalTrials.gov.

OBJECTIVE: The novel coronavirus disease (COVID-19), broke out in December 2019, and is now a global pandemic. In the past few months, a large number of clinical studies have been initiated worldwide to find effective therapeutics, vaccines, and preventive strategies for COVID-19. In this study, we aim to understand the landscape of COVID-19 clinical research and identify the gaps such as the lack of population representativeness and issues that may cause recruitment difficulty. MATERIALS AND METHODS: We analyzed 3,765 COVID-19 studies registered in the largest public registry - ClinicalTrials.gov, leveraging natural language processing and using descriptive, association, and clustering analyses. We first characterized COVID-19 studies by study features such as phase and tested intervention. We then took a deep dive and analyzed their eligibility criteria to understand whether these studies: (1) considered the reported underlying health conditions that may lead to severe illnesses, and (2) excluded older adults, either explicitly or implicitly, which may reduce the generalizability of these studies to the older adults population. RESULTS: Most trials did not have an upper age limit and did not exclude patients with common chronic conditions such as hypertension and diabetes that are more prevalent in older adults. However, known risk factors that may lead to severe illnesses have not been adequately considered. CONCLUSIONS: A careful examination of existing COVID-19 studies can inform future COVID-19 trial design towards balanced internal validity and generalizability.

COVID-19 TestNorm: A tool to normalize COVID-19 testing names to LOINC codes.

Large observational data networks that leverage routine clinical practice data in electronic health records (EHRs) are critical resources for research on coronavirus disease 2019 (COVID-19). Data normalization is a key challenge for the secondary use of EHRs for COVID-19 research across institutions. In this study, we addressed the challenge of automating the normalization of COVID-19 diagnostic tests, which are critical data elements, but for which controlled terminology terms were published after clinical implementation. We developed a simple but effective rule-based tool called COVID-19 TestNorm to automatically normalize local COVID-19 testing names to standard LOINC (Logical Observation Identifiers Names and Codes) codes. COVID-19 TestNorm was developed and evaluated using 568 test names collected from 8 healthcare systems. Our results show that it could achieve an accuracy of 97.4% on an independent test set. COVID-19 TestNorm is available as an open-source package for developers and as an online Web application for end users (https://clamp.uth.edu/covid/loinc.php). We believe that it will be a useful tool to support secondary use of EHRs for research on COVID-19.